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Abstract — We study the diversity order vs rate of an additive 
white Gaussian noise (AWGN) channel in the whole capacity 
region. We show that for discrete input as well as for con- 
tinuous input, Gallager's upper bounds on error probability 
have exponential diversity in low and high rate region but only 
subexponential in the mid-rate region. For the best available 
lower bounds and for the practical codes one observes exponential 
diversity throughout the capacity region. However we also show 
that performance of practical codes is close to Gallager's upper 
bounds and the mid-rate subexponential diversity has a bearing 
on the performance of the practical codes. Finally we show that 
the upper bounds with Gaussian input provide good approxima- 
tion throughout the capacity region even for finite constellation. 

Index Terms — AWGN channel, error exponents, diversity 
order, Gallager's upper bounds, exponential diversity, subex- 
ponential diversity. 

I. Introduction 

In an additive white Gaussian noise (AWGN) channel, 
the bit error rate (BER) decreases exponentially with signal 
to noise ratio (SNR) for various error correcting codes and 
modulation schemes (|6|,|17|) for high signal to noise ratios. 
However, this diversity order (rate of decay of BER with SNR) 
also depends upon the transmission rate. The fundamental 
tradeoff between diversity order and the transmission rate 
(converted to multiplexing gain by normalization with the rate 
of a standard AWGN channel) was first investigated in the 
seminal paper ifTSl for slow fading channel. 

In Q, ||9l a different approach is taken. The authors 
consider AWGN and fast fading channels, BPSK modulation 
and use error exponents to obtain diversity rate tradeoff for 
systems with channel state information (CSI) at the transmitter 
and receiver Diversity order in [7|, [9| is defined as the slope 
of the average error probability vs SNR at a particular SNR. 
At high SNR it can be approximated by the slope of the 
outage probability vs SNR as defined in |10| and [il8l . It 
is shown in Q, ||9l that the capacity region can be divided 
in three regions (as in lO and H?]). The diversity order can 
be qualitatively different in the three regions. In particular, 
it was shown that in low and high rate region the block 
error probability decreases exponentially with SNR while for 
the medium rate region the decrease is polynomial. These 
results were observed for an AWGN channel (without fading) 
also. These results, not reported before, beg the following 
questions. Are these results specific to BPSK only? Since 
these results are observed for upper bounds, do they also 
hold for practical coding and modulation schemes? Do the 
lower bounds satisfy these unusual characteristics? The present 



study is motivated by these questions. Theoretically and via 
extensive computations and simulations we provide answers 
to some of these questions. In this paper we limit ourselves 
to an AWGN channel. In future work we will report our 
investigations on fading channels. 

In the literature there has been much work on the upper 
and lower bounds on error probability for an AWGN channel. 
The upper bound on average decoding error probability with 
and without input constraints is given by Gallager in |3|, 
|4|. This upper bound depends on the input distribution and 
the constellation used for the modulation. In |5|, the optimal 
constellation is derived by maximizing the error exponent in 
the upper bound. These have been studied for continuous 
inputs also with average and peak power constraints on the 
input distribution (Chap. 7, |3|), |4|. The advantage of these 
upper bounds is that they are independent of the constellation 
and the modulation used. 

The lower bounds are also extensively studied in the lit- 
erature. Broadly there are two types of lower bounds on 
the probability of decoding error The sphere packing lower 
bounds (SPB) are lower bounds for all block codes fW\, 
lfT2]| . ifTSll . Another type of lower bounds depend on the 
distance spectrum of codes (for specific codes, not ensembles) 
with BPSK input [13). The classical sphere packing lower 
bound on the probability of error are Shannon's lower bound 
(SP59) for continuous input and large block lengths 111 II and 
Shannon, Gallager, Berlekamp's lower bound (SP67) lfT2l on 
probability of error for a discrete input and discrete output 
channel. Valembois and Fossorier [TS) extended the lower 
bound (SP67) to a continuous output channel. An Improved 
sphere packing lower bound (ISP) obtained is |16| for a 
discrete input and symmetric output channel. Thus presently 
for continuous input, the tightest lower bound is Shannon's 
1959 bound ifTTl while for discrete input and continuous output 

it is ISP nel . 

The error exponents for the upper and lower bounds (O], 
|4]) are equal in the high rate region (region 3) but not in 
region 2 (mid rate region) and region 1 (low rate region). In 
a small fraction of region 2, Burnashev [1| has shown that 
the error exponents for the upper and lower bounds are equal. 
Even though the error exponents are equal in high rate region 
(region 3), the corresponding bounds on probability of error 
are not tight for finite block lengths even in region 3. 

In this paper, we study the diversity order of an AWGN 
channel with M-ary PSK (BPSK, QPSK, 8 PSK, 16 PSK), 
optimum constellation and continuous constellation. We show 
that the distance spectrum lower bounds and Gallagher's upper 



bounds are close to the simulated values for probability of 
error of practical codes. In fact for large block length the Gal- 
lagher's upper bounds can be quite close to the performance 
of the practical codes. Therefore, we study the diversity order 
of these bounds closely. Although we observe exponential 
diversity in most of the capacity region, there is a polynomial 
diversity in a significant rate region of practical importance 
for all the constellations stated above. 

This paper is organized as follows. Section |ll] deals with 
discrete input constellation. In this section, we provide the 
results for M-ary and optimum constellation. The results ob- 
tained from upper bounds are supported with lower bounds and 



simulations. In section III results are provided for continuous 
constellation. Section IV concludes the paper. 



II. Discrete Input 

We consider an AWGN channel with input X and output Y 
where Y = X + W and W is independent of X with Gaussian 
distribution with mean zero and variance a^. In the following 
we take X with values in a finite alphabet x- We study the 
upper and lower bounds on probability of error for different 
constellations and compare with the performance of practical 
codes. 

A. M-ary PSK 

1) Upper Bound on Probability of Error: Consider a block 
coded communication system with block length n and rate R. 
The upper bound on probability of error ((|3], lfT4l ) is given 
by 

' minp>i exp {~n [E^(p) - p(R + ^)] } , 

if Re Region 1 

exp{n[Eo{l)~ R]}, 

if Re Region 2 

mino<p<i exjp {-n[Eo{p) - pR]} , 

if Re Region 3 
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and q — {g(ai), (7(02), ...(/(flg)} is an arbitrary distribution 
vector over the finite input alphabet X. The three rate regions 
are as follows: Region 1 is < i? < |p=i — region 2 is 
{^|p=i-i^ <i?< ^|p=i}andregion3ir{^|p.i < 

For M-ary PSK modulation (usually considered in literature 
lfT6l . IJjj), the signal points are equally spaced on a circle. The 
modulation symbols have equal energy (say 1). We treat the 



channel input X and output Y as 2 dimensional real vectors. 
The input X = {xi,X2) takes values 



ixi,X2) = (cos 6*4;, sin 6*^) 



where 
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2) Lower Bound on Probability of Error: We consider two 
lower bounds. One is the classical sphere packing lower bound 
(ISP). The other is a lower bound based on improvements on 
the de Cane's inequality provided in |2|. The second bound 
is complex to evaluate for large codes. If we specialize it to 
BPSK modulation, the resulting bound depends on the code 
only through its weight enumeration (distance spectrum of the 
code) and is easier to evaluate. Thus we use the improved ISP 
bound from |16| and distance spectrum bound from IJ). These 
are currently the best available lower bounds. 

3) Numerical Results: In this section, we numerically eval- 
uate the upper bound and the lower bounds described above. 
We also compare these bounds with simulation results for 
practical codes. 

We study the diversity-rate tradeoff for M-ary PSK input 
with uniform distribution. We also simulate the communi- 
cation system with BCH encoding and decoding techniques 
with M-ary PSK modulated signals to evaluate the block error 
probability. These are well known codes and were selected 
for their good performance in different applications (e.g., in 
header-error protection of ATM cells and Video codec for 
audio visual services IH). 
Figs{T]|5 



In 



we plot logarithm of probability of error 
vs logarithm of SNR (dB) for BPSK, 8PSK and 16 PSK 
modulation schemes. We also provide simulations for BCH 
codes. The three rate regions are demarcated by vertical lines. 
We observe (Figs[T]|5]) from the upper bound that the decay 
of probability of error with SNR is exponential in region 
3, changes to polynomial in region 2 and then again to 
exponential in region 1. Similar trend was also seen in Q 
for BPSK. This is an interesting result because for an AWGN 
channel, the probability of error for practical modulation 
and coding schemes (ll6l,|[T7|) is upper bounded in terms of 
summation of KiQ functions where Ki and 

K2 depend on the modulation and coding scheme. There 
is no closed form expression for the Q {.) function. From 
the approximate formulae |6|, one observes the exponential 
decay of probability of error with respect to SNR. But, this 
approximation is valid only for high SNR. In our Figures, we 
consider both high and low SNR rate regions. For our BCH 
simulation results also we see only exponential decay. 

We do not see similar changes of slope (as for the upper 
bounds) for the lower bounds Figs [T] |2] There is exponential 
decay throughout. For BPSK modulation, in Fig|T] and |2] 
for different block lengths and rates, we observe that the 
simulations are closer to the upper bound in region 3 and part 
of region 2. The ISP lower bound is very far off while the 
distance spectrum lower bound is closer. From Figs|4] and 
|5] we observe that even for higher modulation schemes the 
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Fig. 1. Upper bound on Pe. Lower Bounds( Distance Spectrum Dependent 
and ISP bounds ) and Simulations of BPSK Modulation with BCH code 



Pe Vs SNR : N=63 R=0.904762 



' Upper bound on Pe 




Fig. 2. Upper bound on Pe and Simulations of BPSK Modulation with BCH 
code 
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Gallager's Upper Bound 




Fig. 3. Upper bound on Pe, Lower Bounds (Distance Spectrum Dependent 
and ISP bounds ) and Simulations of BPSK Modulation with BCH code 




Fig. 4. Upper bound on Pe and Simulations of 8 PSK Modulation with BCH 
code 



upper bound is quite close to the simulated values in region 3 
and upper part of region 2. Fortunately, these are the regions 




Fig. 5. Upper bound on Pe and Simulations of 16 PSK Modulation with 
BCH code 



of most practical interest. For BPSK, 8 PSK and 16 PSK 
modulation schemes, the region 2 is 2.5 dB for block length 
255 and coding rate 0.968 bps. 

From Figs{T||5] we also observe that the simulated curve for 
the BCH codes decay exponentially throughout but the error 
exponents for them are smaller than for the upper bound in 
region 3. The non-exponential upper bounds in region 2 seem 
to have an effect on this. 

One of the applications of an AWGN channel without fading 
is a wireline channel. The ITU-T recommendation G.821 for 
bit error rate (BER) for data circuits is 10^^ and for telegraph 
circuits is 10"''. For BER P^b = 10^* and R = 0.968 bps, 
we get Pe = 0.03. In Fig|2j we consider BPSK modulation 
with n = 255 and R — 0.968 bps. In this case. Region 3 
is 5 — 7 dB where P^ values are from 0.96 to 0.028 and 
Region 2 is 7 — 10 dB where P^ values are from 0.028 to 
0.0025. Thus, the region 3 and upper part of region 2 are 
regions of practical interest. This is the region for which we 
have obtained interesting new properties for the upper bound 
and this is also the region where these bounds are close to the 
BER of practical codes. Thus in the rest of the paper we will 
focus on upper bounds and theoretically show the interesting 
diversity-rate tradeoff observed in this section. 

4) Theoretical Results for upper bounds: We study the 
diversity order for the upper bounds in all the three rate regions 
for M-ary PSK. These results support the numerical results 
provided in the last section. 

Consider region 1. For A/— ary 



Ex (p) = -pin 



> -pin 



M-l M-1 

3=0 

1 



i=0 



1 

M2 









exp 


P . 





(4) 



M 



where 77 is sni", Ki ^ — 4(6^ + 62) — {0-1+0.2) 
sm ^ + sm Oi = I cos 



COS -id- a2 



M 

min. 



'-1:3 



sm 

i.3 



1 

M T"""* M"' "1 ~ 2 
2 , gi^2 2^ 



M 



Ki i where i,j 



M J 
1, 



id 

,M - 



ai 

2 2TTi 

M 



2tH _ 
M J 



COS 

— exp [Krj\ with K 
1. Therefore, 



Pe < exp 



-ns\rp[Ex{p) 
p>i 



p[R 



In 4 

n 



(5) 



The optimal p is obtained by taking the derivative of the term 
in square bracket in Eq. (j5]l and equating to zero. Then the 



RHS of ^ becomes 



exp [~n5{R)ri] 



(6) 



where S{R) is a root of equation, R + ^ = InA/ — "H (5) 
and H (x) = —a; In a; — (1 — x) ln(l — x). These equations 
are vaUd for < i? < InAf — H{Zi). Therefore, exponential 
diversity order (i.e., upper bounds decay exponentially with 
snr ry) is observed in region 1. 

Consider region 3. For M— ary PSK, 

Eoip) - - In {2-i-i W^y;^ ((p + l)aY'} 
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(7) 

We have < p < 1 and |a:;|^+'' < |a;| for |x| < 1. Therefore, 
for l/v/27rCT2 (1 + p) < 1/2 (l/cr2 < ), 
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At the optimal p, maximizing Eo{p) — pR 
dK{p) 1 



^ dp 
which implies 



ln(7r(p+l)cr2) _ l + ln2] (10) 



2e-2«-i 
P= 1 



(11) 



By multiplying Eq. ( [T0| by p and comparing with Eq. Q and 
also from Eq. ( [TT] i, we get 



Eoip)~pR 
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Therefore, we observe exponential diversity in region 3 for 
7? < TT sa 11.45dB. 

Next, consider the case 77 > tt, 
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For < p < 1 and Eq. (23 1, we get Ii < AV2Mu,i'n/n and 
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By multiplying Eq. ( [30| by p and comparing with Eq. (29 1 
and also from Eq. we get 



E,ip) -pR = 



1 



< g-ri(£„(p)-pi?) 

71 /2e-2fl-i 

exp 



In [e^'^^^^T]) -l + log27r 
(33) 



^ - In (2^e"2«-2^) 



— 2 /?— 1 

ne ?7 



(34) 
(35) 



Therefore, we observe exponential diversity in region 3 for 
> TT « 11.45dB. Thus, exponential diversity order is 

observed in region 3 for all rj. 

In region 2, we have Eo{l) = E^il) and the optimal value 

of p = 1. Therefore, 



Pe<exp{-n[Eoil)- R]} 
e~ 



(36) 



For M = 2 (BPSK), the expression is same as that obtained 
in ||9l- To study the diversity order from this bound, we use 
an argument similar to that in JO). The term in the bracket 
decides the diversity order. For low snr, the second term e~'^^ 
dominates for diversity and we see exponential diversity. At 
a higher snr, the bound becomes almost constant with respect 
to J] and the diversity is almost zero. In between one will see 
the diversity order decrease from exponential to polynomial 
to sub-linear to zero. 

B. Optimum Constellation 

The upper bounds obtained above depend on the constel- 
lation used. What constellation one should use on an AWGN 
channel depends on the SNR. In the following we obtain the 
optimal constellation from the algorithm available in 15]. 

The optimization problem is to obtain the input distribution 
(constellation points and the probability mass function) that 
satisfies 



max Er (i?) — sup 

0<p<l 



'pR+ su^{Eo{p)} 
<i 



(37) 



subject to average power constraint J x'^q{x)dx < <Tp and 
peak power constraint \X\ < M < oo. The optimizing 
distribution is discrete and is obtained using the cutting 
plane algorithm (|5|). 

For low rates, we use the expurgated bound but still use 



the optimal input distribution obtained from in ( 37 1 random 
coding bound. 



Numerical Results: The optimum constellation for an 
AWGN channel that allows continuous constellation is Gaus- 
sian input distribution but practical systems are discrete input 
systems. We study the diversity-rate tradeoff in all the rate 
regions for AWGN input the along with the optimum con- 
stellation with average and peak power constraints obtained 
above. 

Figs. |6] |7] show the average probability of error for a real 
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Fig. 6. Upper bound on Pe for optimum constellation and Gaussian input 
: n=50 and R=0.175 



PeVsSNR: N=50R=0.8n 




Fig. 7. Upper bound on Pe for optimum constellation and Gaussian input 
: n=50 and R=0.8 

AWGN channel Y ^ X + N, with optimal input distribu- 
tion for X = { — 10, — 9, 9, 10} (also obtained from the 
algorithm in |5|) and real valued Gaussian input distribution. 
The optimal input distribution is obtained by maximizing 
the random coding bound with block length n = 50 and 
transmission rate R = 0.8 nats/sec and R = 0.175 nats/sec. 
From Figs. |6] |7j we observe that in region 3, the decay of 
upper bound on with respect to SNR is exponential whereas 
in region 2, it is polynomial and in region 1, it is again 
exponential. This holds for the Gaussian input as well as the 
optimal constellation. Also the two curves are quite close. 

If we compare the region 2 for M-ary PSK (Figs. [T|5]) 
and optimum constellation (Figs. 6]|7i the change in slope 
from region 3 to region 2 and then again from region 2 
to region 1 is high for M-ary PSK compared to optimum 
and continuous constellation. Thus, the massive performance 
degradation seen in the upper bound in regions 1 and 2 in 
Figs.fTplseems to be largely due to improper input distribution 



and constellation, although the linear region 2 in Figs. 6]7 still 
degrades the performance. From these curves we see that upper 
bounds on continuous inputs provide more realistic bounds on 



performance of practical codes even though they have discrete 
alphabet. The continuous alphabet code also has the advantage 
that same bound can be used for all the constellations. Thus 
we theoretically study upper bounds for continuous alphabets 
in the next section. 

III. Continuous Input 

A. Upper Bound on Average Probability of Error 

Consider a time-discrete amplitude-continuous memoryless 
channel with X^Y E C, the set of complex numbers. We 
assume that maximum likelihood decoding is performed at 
the receiver 

For a block length n, transmission rate R and proba- 
bility distribution on the use of code words qx (x) with 
^(?x(x){I^P} 1^ 2P, the probability of decoding error is 
upper bounded as in Eq.Q where the summations over x are 
replaced by integration. 

With Gaussian input distribution with mean zero and vari- 
ance rj, we get 
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From |14|, we have p > 1 in region 1. Let Si = ^, then 
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Therefore, in region 1 we observe exponential diversity order 
Next, consider region 2. The optimal p = 1 lfT4ll . Thus, 
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which shows polynomial diversity in region 2. 

Next, consider region 3. The p that optimizes the Eo — pR, 
is given by 
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Thus, 
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where p* is the optimal p. Since p* is a function of 77 (see (44 1) 



we donot see the explicit diversity order from (45 1. Although 
p* is a complicated function of rj, it is very close to linear 
Thus we approximate it by p* (rj) = a + brj. The exact values 
of a and b depend on R. For R ^ 1, a — —0.37,5 — 0.23. 
Plugging this in the RHS of ([45]l gives 
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We plot upper bound in 
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in Fig. 



^ _ Let 

<53(i?,r/) = (a + 6?7)V[(l + a + 67/)2(,7/(l + a + 6,^f+l)]. 
We plot Sz{RtVi) in Fig. |9] and observe that it is linear, 
increasing function of -q. This implies that from (46 1 we obtain 
exponential diversity. 




Fig. 8. Comparison of actual bound Eq. \A5\ and approximated bound when 
p is approximated hy a + b-q Eq. BS) 



B3{R,ri) vs ri 




Fig. 9. For R= I, SsiR, rf) witli respect to r). 

IV. Conclusions 

In this paper we study diversity-order rate tradeoff for an 
AWGN channel. These aspects of an AWGN channel are taken 
for granted and usually not studied. We find some interesting 
results. For Gallagher's upper bounds on probability of error, 
the diversity order of an AWGN channel is exponential in low 
and high rate region. However in the middle, the diversity 



order is polynomial and some times even zero. The diversity 
order for the available lower bounds is exponential throughout. 
Studying some practical (BCH) codes we find that although 
their diversity is exponential, theire BER is quite close to that 
of the upper bounds in high and mid-rate regions especially 
for large block lengths. Thus the mid rate non-exponential 
diversity of upper bounds have a bearing on the performance 
of practical codes. 
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